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ABSTRACT 



A study examined assessment of students in the 



Technical and Further Education (TAFE) systems in Australia with 
reference to moderation processes and the maintenance of standards. 
Data were obtained through a multiple case-study technique, using 
visits to six of the eight major TAFE systems; focus group interviews 
were held with selected stakeholders in the system* The study found 
that the six systems use different policies and procedures in the 
assessment of students. Both internal and external assessment is 
conducted, and there is no clear systematic effort by TAFE 
authorities for moderation and maintenance of standards in the 
training programs. The study revealed that current practices need to 
be revised because of the following: (1) the development of a major 
role in assessing and certifying the attainment of job skills alon^ 
with the associated legal/industrial relations implications; (2) the 
formalization of articulation arrangements with higher education 
institutions; (3) the progress toward a national approach to the 
determination of training standards and certification requirements; 
(4) the assessment of competencies acquired rather than time spent on 
training as a basis for certification; (5) the balance between core 
competencies developed nationally and training designed to meet 
individual company requirements; and (6) the recognition and 
assessment of prior learning * The study recommended systematic 
moderation processes and maintenance of standards through policy 
action, professional development, networking, and support services to 
TAFE colleges* (18 references) (KC) 



* Reproductions supplied by EDRS are the best that can be made 

* from the original document. 
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ASSESSMENT AND MAINTENANCE OF STANDARDS 
IN VOCATIONAL EDUCATION DOWN UNDER 



Perspective of the study 



Aua.ra.la is changing .he way I. trains and educates Hs workforce (Field. 1990). The key 
featU res of such changes are .he development of national sK.«. standards 
CT ea«on of career paths .or employees, me implementation o. competency-based training, and 
me recognition of training across S.a.es. In additioh. emphasis Is being placed on .he 
^deration of quality learning outcomes, on recognition o. prior learning, and on etflctency 
These .actors can be expected to iead to a cioser scrutiny of me maintenance o. standards In 
ITocattona, .raining provided by Technical and Funher Hducanon (TAPE) cdleges 
(Nattona. Training Board, 1991). The eight voca.lonal fining systems in Australia^ diverse 
and ft* will have to ensure .ha. .hey maintain moderation processes and standards to achieve 
quality learning outcomes a. .he colfcge. state, and na,lonal levels (Kirby, 1990). The 
assessment o. students Is one o, the key components that has Immediate implications or me 
achievement of moderation and the maintenance of standards (Thompson & Pearce. 1990; 



Hayton, 1989). 



Objective of the study 



This paper examines the current condition of assessment of students in the TAPE systems in 
Australia with reference to moderation processes and the maintenance o. standards. It 
ascribes the current assessment policies, procedures, practices and ^ara«on processes, 
and makes suggestions for Improving the maintenance of standards in Australian TAPE colfeges. 



Methodology and data source 



A multiple case study technique (Yin. 1989, was undertaken to invests th cunen ^ cond. Ion 
o, »e assessment o, students. Data were collected through visits to selected TAPE systems and 
TAPE colteges; and from the relevant ll.era.ure (Navaratnam. 1991). Six of the eight ma|or TAPE 
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systems were purposely selected for the case studies. Focus group Intends wtih selected 
cotiege personne., administrators In State Office, and with other stakeholders In the TAPE 
system were conducted to gain .nslghts fnto the foiling: background Information on each 
TAFE organisation; assessment policies; assessment procedures and methods; responses 
concemfng assessment of students; moderation and ma.n,enance o, standards; exempfary 
practices In the assessment of students; reporting of resuhs to students; problems and tasks 
Ltved in ma.ntaln.ng standards In me assessment of students; current Initiates towa d 
m a.ma,nlng standards in assessment of students; and their implications for quality learning 
outcomes. 



Findings 



There are eight dtiferen. TAFE systems representing all Ste.es and Territory in Australia and 
rhey are the ma|or public providers of skills training required by the workforce. They account for 
approximately 70% of post-secondary education enrolments. Each Sate and Territory 
administers Ite own TAFE system. The Commonwealth contributes approximate,, 8% of total 
funds TAFE coileges offer associate diploma, certificate, and other awards and also non-award 
courses. A number of TAFE colleges also offer secondary school sublets and English 
Language Intensive Course for Overseas Students (ELICOS) courses. TAFE courses are 
oevefoped in collaboration with industry and the communKy to ensure up-to-date education and 
training. The foltowing paragraphs describe the assessment poilcies, procedures, processes, 
and .he method of moderation and maintenance of standards In six TAFE system in Australia. 



Queensland TAFE 

TAFE in Queensland Is administered by the Department of Employment, Vocational Education, 
Training and Industrial Relations (DEVETIR). DEVETIR provides services related to Industrial 
relations; workplace health and safety; worker's compensation; and employment, and vocational 
education and training. Technical and Further Education, Training and Employment Queensland 
(TAFETEQ) of the DEVETIR Is charged with delivery of vocational training In order to meet the 
Government's ob|ec«ves for vocational education, training and employment In the context of 
social and economic development. More than 200,000 students enrol annually In 30 TAFE and 
3 Senior Coileges. 
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With the introduction of College-Based Assessment (C-BAS) In 1978. TAFE colleges are 
responsible and accountable for developing and conducting tbeir own assessment of students. 
In order to support the C-BAS process. TAFE colleges are encouraged to establish College 
Assessment Committees (CACs). In this way. coileges devise and administer both summative 
and formative assessment Instruments at the classroom level without the need to refer to any 
external agency. In fact, the alms of C-BAS assessment are to: (1) improve standards of 
assessment In colleges, (2) assist teachers in the area of student assessment. (3) ensure 
appropriateness, adequacy, consistency, and reasonable coverage between curriculum and 
assessment, and (4) ensure a fair assessment of students. At present, central assessment is 
conducted only for those apprenticeship courses that Involve licensing by external agencies. 
The agencies have a legislative authority to license graduates so that they can be employed in 
their tsade areas. 

The State Office, and more specifically the Division of Vocational Education and Training (DVET) 
is responsible for maintaining standards and consistency in all forms of assessment across the 
TAFE system. As a part o. CBAS. it is required to evaluate a 5% sampie of C-BAS assessment 
instruments In various subjects from the preceding examination period with respect to their 
overall suitability, consistency with the approved syllabus, and comparability across colleges. 
DVET is also responsible for facilitating college-based peer evaluations for another 5% sample of 
examination papers or assessment instruments for a selected group of subjects. The matters to 
be considered In these evaluations include: format/presentation, Instructions to students, 
guidance to markers, weighting of marks, appropriateness of instrument, question suitability, 
coverage of subject content, degree of difficulty, question construction, completion time, and 
purpose. Thus, these two types of evaluations are scheduled to be conducted each semester 
and reported annually to give guidance on assessment to teachers and to maintain assessment 
standards in vocational education and training. 



Victorian TAFE 



The State Training Board (STB) of Victoria is a statutory authority responsible for the State 
Training System (STS). The Office of the State Training Board (08TB). a Public Service unit 
within the Ministry of Education, is responsible for administering the STS. The STB enables 
TAFE colleges to propose ways in which they may meet training needs. The TAFE colleges are 
autonomous agencies within the STS and are governed by College Councils. There are 32 TAFE 
colleges and 16 other facilities, and over 260.000 students are enrolled in them. 
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There are 18 TAPE colleges which are described as -Designated Providers", responsible for the 
statewide management and development of curriculum for a specific Industry or field of study. 
The Designated Providers work in ciose consultation with the relevant Industry Training Board 
and establish Management Committees consisting of representatives from relevant providers and 
the STB to ensure that the development of training programs is In accordance with industry s 
priorities and Government policy. The Examinations Branch within the STB is responsible for 
conducting external examinations while Internal examinations are the responsibility of TAPE 
colleges. Designated Colleges make major contributions to curriculum development, the 
accreditation of courses, and the assessment of students. 

With reference to the internal assessment of studefa In Victoria moderation, and the 
maintenance of standards aeem to be ma|or concerns. There Is little evidence that mere are 
specific mechanisms in place for moderadon or the maintenance of standards in Internally 
assessed subjects. Major strengths in the assessment of student* in the Victorian State Training 
System as identified by the staff include: the strong central system of assessment In many 
subjects; well-organised moderation of curriculum content and assessment Instruments for 
externally-assessed subjects, and the operation of test banks for many externally-assessed 
subjects. 



South Australian TAFE 



The South Australian Department of Technical and Further Education (DETAFE) consists of eight 
major divisions: administration and finance, planning and systems, curriculum services, human 
resources, program division, physical resources, employment and training, and youth aHalrs. 
The Curriculum Services Division manages five broad statewide functions: provision of policy 
and procedural advice, development and review of courses, approve, and accreditation of award 
courses, maintenance of course standards, development of learning and resources, and delivery 
systems. 

DETAFE offers about 300 award courses and many other short courses and individual subjects 
through a network of 20 colleges. 13 metropolitan and 7 country, and many other teaching 
centres DETAFE provides courses for about 100,000 students. There are 19 educational 
programs and each has a Course Standard Group (CSG) and a Program Group (PG). Course 
Standards Groups consist of six members, Including not less than one from the relevant 
Program Group, a. leas, one who Is no. a member of me PG, and one from Curriculum Services 
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fusion. Course Standards Groups are established to monitor and make recommendation to 
improve the standards In TAFE courses and across the colleges. 

Program Groups ate organised to P .an and devetop the delivery of TAPE courses enlcient* and 
actively. The PG Is responsible for the Program Planning Management Committee and it Is 
expected that it might take over the responsible with regard to maintenance of standards .n 
TAPE courses in the near future. The Program Management Committee Is made up of the 
College Directors. The PG Is considered to be a more powerful body than the CS6. The PG 
conducts Ks meetings month* while the CSG meets oniy a, the end of the —on per od. 
These two groups are program specKic and independent of each outer in terms of their 
and responsible, Thus they do no. hold a common meeting. Slmllariy. statewide meetings 
are conducted separately to monitor the activities of the each group in relation to their 
responsibilities. 

College-based assessment is mainly used tor award courses and centra, assessment Is used 
only in a very few courses. Subject advisers take major responsibility for the design, 
development, and conduct of assessments. The maior features of the central assessment 
process are the use of marking schedules, marking keys, and marking In a central piece by 
teachers teaching those subjects. The maior s.engths of the maintenance of standards In the 
assessment process Is in the functioning of the CSGs and PGs in each of the ™jor program 
areas In addition, there » a commitment by the cdleges and the Curriculum Services Division in 
terms of resources for maintaining standards and quality in the provision of TAPE programs. 



Western Australian TAFE 

The Department o. Technical and Further Education (DTAFE), Western Austiaila, conslste of 12 
metropolitan campuses, five regional TAFE colleges. 7 regional centres and about 110 TAFE 
centres throughout Western Australia. AH TAFE cdieges are open for up to 50 wee s a year. 
The Central Office has been restructured to give effect to a central focus on policy formulation, 
planning, resource co-ordination, and curriculum integration. Thus, the new administrative 
management for service delivery In TAFE provides for a stronger regional approach. A Board of 
Directors represents the maior policy formulation group in TAFE. The management and 
administrative model Includes strong representation from the delivery system .0 ensure mai ms 
College Directors are contributors to the decisionmaking process. There are about 1 30,000 
students enrolled in the TAFE colleges. 
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The Western Australian Government has established the State Employment and 
Development Authority (SESDA) In oon|unctlon with the reatruoturing of me DTAFE. SESDA is 
overseeing the direction o. TAPE and its delivery. I. la responsible for developing policy relating 
« fining In Western Australia through a network of Industry Employment and Training Councils 
UETCS) and the Skill Standards and Accreditation Board (SSAB). The lETCs provide Wormahon 
,o the SESDA concerning the skill formation priorities of Industry groups. It Is responsible or 
coordinating advice to government and to Industry on Issues relating to skill standards, ski., 
tormation needs and priorities, and equal opportune in access to skill formation programs. 
SSAB is responsible for quality con.ro. In the training programs conducted In Western Ausba a. 
„» accreditation of skill formation programs and the accrednatlon of an Individual's skHte. SSAB 
also monitors State and national training standards. 

The Designated Colleges and the Study Area Consultants are responsible for conducting 
axterna. examinations while Internal examinations are the responsibility of TAPE campuses. 
Designated Colleges make maior contributions to curriculum development, the accreditation of 
courses, and the assessment of students. The Study Area Consultant's duties Include 
monitoring the examination process and standards, nominating examiners, co-examiners and 
co-ordinating examiners. However, moderation and the maintenance of standards seem to be 
mal o, concerns to the admin— of the TAPE system. There Is no clear functional dkedon 
with regard to moderation and the maintenance of standards in the WA TAFE system Major 
strengths In the assessment of students in the WA TAPE system include the use of Study Area 
Consultants, networking by study areas, central examinations, and the development and use of 
common instruments for internal assessment in some study areas 



New South Wales TAFE 



The New South Wales Department of Technical and Further Education is responsible for 
vocational training In that State. The Training Divisions (TDs) have 10 Industry Training Divisions 
(ITDs) and 3 Education and Training Divisions (ETDs). The staff of an ITD Includes a Chief, an 
industry Specialist, a Cluster Manager, a Marketing Manger, a Curriculum Manager, a Curriculum 
Coordinator, a Quality Assurance Coordinator, and support steH. The ITD structure consists of 
several industry sectors and thus Is the focal point for Interaction with Industry. TAFE training 
provision for each sector of induatry Is managed by Industry specialists. The major functions of 
the Industry Specialists include: liaison and consultation with industry, management of the 
development, review, evaluation and accreditation of all statewide courses, provision of 
curriculum documents and assessment schedules to colleges and networks, planning and 
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implementing quality assurance, assistance with human resource development, assisting 
colleges with the development of curriculum, ensuring course articulation arrangements, and 
providing strategic learning advice. 

The primary responsibility of TOs is to plan, co-ordinate and contract the production of curricula 
in line with forecasts of national and state skill needs and In response to local industry 
requirements identified by colleges and networks as well as by the ITDs themselves, setting 
requirements, planning, establishing course content, coordinating and overseeing, curriculum 
development, and evaluating state-wide outcomes. ITDs are responsible for ensuring that all 
TAFE courses such as basic, preparatory and access programs, trade and para-professiona! 
courses, conform to needs criteria, quality standards and agreed outcomes in terms of 
competency standards, resulting in student satisfaction and employer satisfaction. Thus, iTDs 
will set quality specifications for teaching staff, course content and resources and will assist 
colleges in their quality control activities. 

TAFE colleges have been grouped into networks and all the networks placed Into three major 
network groupings, according to the specific geographical areas they serve. The major 
responsibilities of the Network Managers are to ensure that: support services to colleges are 
adequate and appropriate to achieve agreed educational outcomes and financial targets; 
resources across member collages In the Networks are used In the most effective way; quality 
control standards are consistent across member colleges, and colleges Implement appropriate 
staff selection and promotion procedures and practices. 

The Assessment Research and Development Unrt (ARDU) within the Curricuium Policy Division is 
responsible for conducting external examinations while internal examinations are the 
responsibility of TAFE colleges. Industry Training Divisions set quality specifications for 
teaching staff, course content and resource use. There are four categories of courses: centrally 
approved, school approved, college approved, and outreach course approval. Syllabus 
documentation for the centrally approved and school the approved courses requires a specific 
summary of assessment statements and practices. The other two categories of courses are not 
formally assessed. Examination specifications gives details of what should be tested in an 
examination. A review of marks and results is carried out at the college and at the central office 
level. The maintenance of standards in the assessment of students begins with the syllabus 
document and it is conducted by the ARDU. 
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ACT Institute of TAFE 



The Australian Capital Territory (ACT) Institute of TAFE operates from three major teaching 
campuses in Canberra: Bruce, Reid, and Woden. There are five other small campuses providing 
various specialised programs. The Institute has three major administrative structures: an 
Education Delivery Program, an Education Program, and a Corporate Services Program. There 
are nine teaching schools within the Education Delivery Program, four units within the Education 
Program, and five units within the Corporate Services Program. There are about 20,000 
enrolments in 1991. There is no duplication of courses and related services by the campuses. 

The assessment of students within the Institute is school-based. Assessors and co-assessors 
take major responsibilities for the design, development, and conduct of assessments. As a part 
of the assessment process, an assessment plan is developed prior to the commencement of 
teaching. The major features of the assessment plan is the use of marking schedules and 
marking keys. Use of the marking scheme and marking keys and the provision of Information 
about them to students at an early stage of enrolment in the subject are considered to 
contribute to exemplary practice. The major strengths of the assessment process conducted by 
the Institute, as identified by the staff, include: the use of a current assessment policy and 
guidelines, use of an assessor and co-assessor for the design, development, and conduct of 
assessment, and the preparation and use of an assessment plan and information to students 
about it in advance. 



Educational importance of the study 

The six TAFE systems described above ail use different policies and procedures in the 
assessment of students. A combination of both internal (college-based) and external (central) 
assessment of students is conducted by them. There is no clear systematic effort by TAFE 
authorities for moderation and the maintenance of standards in their training programs. This 
study revealed that the current assessment of students and maintenance of standards need to 
be revised for a variety of reasons. Some of the major reasons include: (i) the development of a 
major role In assessing and certifying the attainment of on-the-job and off-the-job competencies 
along with the associated legal/industrial relations implications; (II) the totalisation of 
articulation arrangements with higher education institutions; (lii) the progress towards a national 
approach to the determination of training standards and certification requirements; (iv) the 
assessment of competencies acquired rather than time spent on training as a basis for 
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certification; (v) the baiance between core competencies developed nationally and training 
designed to meet individual company requirements; (vi) the recognition (and assessment) of 
prior learning; and (vli) Freedom-oMnformation legislation. 

Variations in the organisation and administration of the TAPE systems as well as in the policies 
and processes adopted in the assessment of students lead to few commonalities in the 
maintenance of standards among them. Thus, it is not possible to make rational comparisons of 
moderation and maintenance of standards in the assessment of students. This study also 
revealed that there is little exemplary practice in the assessment of students that can be 
emulated by others. However, the findings of this study offer several insights and propositions 
concerning the maintenance of standards in the assessment of students and the achievement of 
quality learning outcomes. 

Specifically, this study recommends systematic moderation processes and maintenance of 
standards through policy actton, professional development, networking, and support services to 
TAFE colleges. It also suggests that all stakeholders In WE systams across the nation must 
take corrective action to overcome the failure of the current system to respond to moderation 
and the maintenance of standards. Although some TAFE systems are taking initiatives toward 
this end the rate of implementing moderation and maintenance of standards in the assessment 
of students needs acceleration. TAFE authorities must Improve the process of course 
development, thus facilitating moderation and maintenance of standards. During the past 
couple of years, different TAFE systems in Australia have Invested considerable amounts of 
humr * and material resources In Improving the organisational and operational effectiveness and 
efficency of the provision of vocational education. The result has been some lack of attention 
to the quality of learning outcomes in TAFE colleges. The time has come, and It is the right 
time, to make substantial efforts toward moderation and maintenance of standards In the 
assessment of students and In turn in the provision of vocational education. 

Considering current developments In vocational education and training, the maintenance of 
standards in internally assessed subjects Is vitally important to keep pace with the national 
initiatives. For this reason, customer oriented quality improvement approaches must be used. 
Customers of vocational education and training are sufficiently astute to be able to differentiate 
between poor and good quality training and services provided to them. They are rational 
decision makers and they have certain needs and expectations about training programs, and 
other services. They compare the TAFE systems, colleges, courses, and graduates with one 
another. 
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Establishing an effective quality assurance or Total Quality Management (TQM) process In a 
TAFE system is a complex and a stable undertaking. The Introduce of quality concepts Into 
vocational education and training requires new directions in the management and delivery of 
TAFE courses. Considerable commitment by management and Increased resources are 
required to do it well and to ensure its continuity. Moreover, what Is important is to develop a 
customised quality assurance process that Is relevant and pracflcally feasible for the specie 
conditions of each of the TAFE organisations. 

Moderation, maintenance of standards, and quality of learning outcomes cannot be achieved 
trough improvement in the assessment of students alone. There is a need for system-wld, 
improvement mat should be developed In every component In the process of the deliver of the 
education and training, including curriculum development, teaching methods and strategies, 
staff development. Invoivement of Industry, development of standards, management strategy, 
and implementation of programs and policy. Quality concepfs can be applied and need to be 
applied to achieve quality learning outcomes through making seif-susfalned Improvements in the 
whole provision of the vocational education and training down under. 
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